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DESCRIPTION 
Reld of the Invention 

The invention relates to a method of enhancing a content comprising original program 
5 streams, by adjunction of at least one enhancement program stream associated to at least one 
of said original program stream. 

The invention also relates to a computer program comprising instructions for 
implementing such a method, and an authoring system intended for executing such a program. 
The Invention also relates to a signal obtained by applying such a method, and to a data 
10 carrier storing such a signal. 

The invention also relates to a device for reading such a signal. 
The invention notably applies to contents that are compliant with the DVD Specifications 
for Read-Only Disc, part 3 Video Specifications, version 1.1, December 1997 (called DVD 
specifications in the following of the description). 
15 For instance it allows the enhancement of a video content so as to provide a high- 

definition video content. 

Background of the invention 

In the DVD specification, audio, video, sub-picture and navigation data elementary 
20 streams are multiplexed at the pack level to form a program stream (called VOB - Video Object - 
in the DVD specification). 

One solution to produce an enhanced content that complies with the DVD specification 
is to multiplex enhancement elementary stream(s) with the above-mentioned elementary 
streams at the pack level. 
25 As the elementary streams are multiplexed at the pack level, it is not possible for the 

players to read only part of them. 

Therefore, with such a solution, players will have to read all the data of an enhanced 
program stream In order to achieve de-multiplexing and recovery of the elementary streams. 
It means that the enhanced program streams must comply with the transfer rate restrictions 
30 defined in the DVD specifications (table 5-2 for contiguous streams and annex K for interleaved 
streams) so as to be readable by any DVD compliant player. 

As a consequence the upper limit of 10,8Mbps (defined in table 5-2 of the DVD 
specifications) cannot be exceeded. 

One of the object of the invention is to propose a solution allowing to exceed this upper 
35 limit while permitting reading by any DVD compliant player. 



Summary of the invention 

This is achieved with a method of enhancing a content as claimed in daims 1 to 3, with 
a program comprising Instructions for implementing such a method as daimed in claim 4, with 
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an authoring tool as claimed fn claim 5, with a data carrier as claimed in claim 6 and 8, with a 
signal as claimed in claim 7 and 9, and with a device for reading a signal as claimed In claim 10. 

The invention applies to any content comprising contiguous blocks containing a program 
stream and interleaved blocks containing interleaved program streams, wherein the program 
5 streams are divided into program units and are readable independently one from the other, and 
the occurrence of consecutive interleaved blocks is forbidden. 

According to the invention: 

- each program unit of the enhancement program stream is associated to a program unit of the 
original program stream; 

10 - the enhancement program stream is interleaved in the content at the program unit level in 
such a way that enhancement program units are as dose as possible to the original program 
unit they are associated to, and occurrence of consecutive interleaved block is avoided; 

- and the original program units are pointing towards the enhancement program units they are 
associated to. 

15 The invention makes it possible to introduce the enhancement data in the content as 

one or more enhancement program streams while avoiding occurrences of consecutive 
interleaved blocks. 

As the enhancement program streams are interleaved with the original program streams 
at the level of the program units, it is possible for players to skip them when reading. 
20 Therefore players may either read the original program stream(s) only, or both the 

original program stream(s) and the enhancement program stream(s). 

Consequently it is not necessary anymore to comply with the 10,8Mbps transfer rate 
upper limit Players that cannot achieve transfer rates higher than 10,8Mbps will still be able to 
retrieve the original content More recent players that can achieve higher transfer rates wiJI be 
25 able to retrieve both the original content and the enhancement content 

In other terms, the invention allows to exceed the 10,8Mbps upper limit while 
maintaining compatibility with existing players that cannot achieve higher transfer rates. 

The feature claimed in daim 2 is advantageous because It requires less memory and it 
simplifies the playback implementation. 
30 The feature of claim 3 Is advantageous, espedaliy when the enhancement program units 

are read before the associated original program units (and therefore have to be buffered until 
the assodated original program units are read), because it minimizes the quantity of data to be 
buffered. 

35 Brief description of the drawings 

These and other aspects of the Invention are further described with reference to the 
following drawings: 

- figure 1 is a schematic representation of the structure of a contiguous block, 

- figure 2 Is a schematic representation of the structure of an interleaved block, 
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- figure 3 is a schematic representation of a program unit according to the DVD specifications, 

- figure 4 is a schematic representation of an example of enhanced content according to the 
invention, 

- figure 5 is a schematic representation of an enhancement of a contiguous block that lead to an 
5 occurrence of consecutive interleaved blocks, 

- figure 6 is a block diagram of a method of enhancing a content according to the invention, 

- figure 7 is a first example of application of the method according to the invention, 

- figure 8 is a second example of application of the method according to the invention, 

- figure 9 Is a block diagram of a reading device according to the invention, 

10 - figure 10 is a block diagram of an authoring system according to the invention. 

p^CT-ri ptinn of a orp fprreri embodiment 

The embodiment that will be described below relates to the DVD specification. This Is 
not restrictive. The Invention also applies to other types of content having a similar 
15 contiguous/interleaved structure according to which occurrence of consecutive interleaved 
blocks must be avoided. 

In the DVD specification, program streams are called Video Objects (VOB) and program 

units are called Video Object Units (VOBU). 

According to the DVD specifications, contents comprise contiguous blocks and 
20 interleaved blocks. In a contiguous block. Video Objects Units are stored in a contiguous 
manner. 

Figure 1 gives an example of two contiguous blocks CBi and CBj. The contiguous block 
CBi comprises a Video Object VOBI containing M Video Object Units (i,l), (I, M). The 
contiguous block CBj comprises a Video Object VOBj containing P Video Object Units 0/1), 
25 g,p). The Video Object Units of the Video Objects VOBi and VOBj are stored consecutively one 
after the other. 

In an interleaved block, Video Objects are divided into areas called interleaved units 
(ILVU), and the Video Objects are interleaved at the level of the interleaved units. According to 
the DVD specifications, an interleaved unit may comprise one or more Video Object Units (called 
30 VOBU). In the following, for simplification purpose, we will consider that an interleaved unit 
comprises only one Video Object Unit. 

Figure 2 gives an example of an interleaved block IL comprising two Video Objects VOBk 
and VOBI. The Video Objects VOBk and VOBI respectively comprise M Video Object Units (k,x) 
and (l,x) with x=l to M. The Video Object Units C,x) are stored just behind the Video Object 
35 Units (k,x). 

In an interleaved block the reading device reads data sequentially while skipping data 
that do not require reading. For instance, in figure 2, arrows J indicate that the reading device is 
skipping the video Object Units (l,x). In practice Video Object Units of interleaved Video Objects 
comprise a pointer, called reading pointer, pointing towards the next Video Object Units in the 
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same Video Object so as to allow skipping from one Video Object Unit to the next Therefore 
Video Objects can be read Independently one from the other. 

As Indicated in paragraph K5 of the DVD specifications, the occurrence of consecutive 
interleaved blocks must be avoided in order to achieve seamless playback of the content. It 
5 means that two Interleaved blocks must be separated by at least one contiguous block. 

Figure 3 gives a representation of the structure of a Video Object Unit. As represented in 
figure 3, a Video Object Unit VOBU comprises multiplexed packs including navigation packs N, 
audio packs A, video packs V and sub-picture packs SP. 

The invention deals with enhancing a content by adding one or more enhancement 
10 Video Objects to the content Each enhancement Video Object is associated to an original Video 
Object During playback of the enhanced content both the original Video Object and the 
associated enhancement Video Object will have to be retrieved. To avoid slowness of the 
playback, the enhancement information have to be stored close enough to the original 
information it is associated to. This is achieved by interleaving the enhancement Video Object in 
15 the original block to which the associated original Video Object belongs. 

By doing so, contiguous original blocks are transformed into interleaved blocks. This is 
shown in figure 4. In figure 4 a contiguous block CB is represented which comprises one single 
Video Object splitted Into M original Video Objects Units Ui, U M . An enhancement Video 
Object Unit HJJi (1=1,..-, M) is associated to each of the original Video Object Unit U lf U M . 
20 The enhancement Video Object Units HJJi, H_U M are interleaved with the original Video 
Object Units Ui, U M . The resulting block IL is an interleaved block. 

If the contiguous original block is adjacent to an interleaved block In the original 
content, transforming a contiguous original block into an interleaved block leads to the 
occurrence of consecutive interleaved blocks in the enhanced content Figure 5 gives an 
25 example of such a situation. In figure 5, a sequence SI of three blocks is represented. It 
comprises an interleaved block III, followed by a contiguous block CB2, followed by an 
interleaved block IL3. After enhancement, this sequence is transformed into a sequence SI' that 
comprises three consecutive interleaved blocks IL1', IL2 # and IL3'. 

The invention proposes a method to enhance such a content via Interleaving while 
30 avoiding occurrence of consecutive interleaved blocks. Figure 6 is a block diagram representing 
the steps of a content enhancing method according to the invention. 

The original content is processed block by block. The algorithm described below by reference to 
figure 6 uses a three blocks sliding window [B H ; Bi; B^j] centred on the block to be currently 
processed (B,). The first block of the window (Bw) was processed in the previous iteration of the 
35 algorithm. The third block of the window (Bj+O will be processed in the next iteration of the 
algorithm. The current Iteration deals with the enhancement of the central block B,. In figure 6, 
it Is assumed that the original content comprises Q blocks (thus I varies from 1 to Q). For each 
Iteration I of the algorithm, the following steps are executed: 

At step KQ, it is checked whether the original block B, is to be enhanced. If the original block Bj is 
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to be enhanced (arrow Y), then step Kl is executed. If the original block Bj is not to be 
enhanced (arrow N) then step Kll Is executed. 

At step Kl r it is checked whether the original block to be processed (BO is a contiguous block; If 
Bi is a contiguous block (Bi=CB), then step K2 is executed; if Bi Is an interleaved block (Bi=IL), 
5 then step K9 is executed. 

At step K2 r it is checked whether interleaving the enhancement Video Objects) Into the original 
block Bi would lead to an occurrence of consecutive interleaved blocks in the content (this is the 
case when Bh and/or B l+ i are interleaved blocks); if the answer is yes (arrow Y), then step K3 Is 
executed; if the answer Is no (arrow N), then step K9 is executed. 
10 At step K3, the original block Bj Is split into a main block MBj and: 

- one pre-separation block SB1, If B w is an interleaved block, 

- and/or one post-separation block SB2, if B J+1 is an interleaved block. 
After step K3, step K4 is executed. 

At step K4, the enhancement is achieved by: 
15 - interleaving the enhancement Video Object units (H_MBi) associated to the original Video 
Object Units of the main block MBI, If any, into the main block, thereby transforming the 
contiguous main block MBi into an interleaved block MB1'; 

- interleaving the enhancement Video Object Units (H_SB1 / H_SB2) associated to the original 
Video Object Units of a contiguous separation block (SB1 / SB2), if any, into an interleaved block 

20 that is adjacent to said contiguous separation block (which means either into ILL' or into MBi' for 
H_SB1, and either Into MBi' or into IL2' for H_SB2), 

- leaving the separation blocks SB1 / SB2 unchanged and using them as separation between the 
interleaved block MBi' and the preceding/ following interleaved blocks. 

At step K9, the enhancement Video Objects) are interleaved into the original block Bj, thereby 
25 generating an interleaved block Bi'. 

Step K10 is executed after step K4 and after step K9. 

At step K10, a pointer PTJH is added in the original program units to point towards the 
associated enhancement program unit 

At step Kll, the index i is Incremented, and the next Iteration of the algorithm is started. 
30 It is to be understood that this method is applicable to enhance one or more Video 

Objects of an original block. 

The method described In figure 6 will now be further explained by way of two examples. 

In figure 7 it is assumed that In the sliding window Wl: 

- the first block Bn is an interleaved block (ILL) comprising two original Video object IL1_1 and 
35 IL1_2, and the associated two enhancement Video Objects H__IL1_J. and HJL1_2, said Video 

Objects being interleaved In the following order: 
IL1_1/H JU_1AL1_2/H_IL1J> ; 

- the second block B, is a contiguous block (CB2); 
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- the third block Bj +1 is an Interleaved block (IL3) comprising two original Video object IL3_1 and 
IL3J2. 

According to the invention, the contiguous block CB2 is split into three contiguous blocks: a pre- 
separation block CB2a, a main block CB2b, and a post-separation block CB2c. 
5 CB2b Is enhanced with H_CB2b. 

With a first implementation of the method of the invention (PI), the enhancement Video Objects 
H_CB2a and H_CB2c are interleaved into the interleaved block that precedes the contiguous 
separation blocks, which means that: 

- H_CB2a is interleaved in ILL thereby generating a new interleaved block IL1' which comprises 
10 the Interleaved Video Objects ILl - l/HJLl„l/IU - 2/H_ILl_2/H_CB2a / 

- H_CB2c is interleaved with CB2b and H_CB2b thereby generating an interleaved block CB2' 
which comprises the interleaved Video Objects CB2b/H_CB2b/H_CB2c. 

The pre-separation block CB2a is inserted between the interleaved blocks ILT and CB2'. And the 
post-separation block CB2c is appended after CB2'. 
15 With a second implementation of the method of the Invention (P2), the enhancement Video 
Objects H_CB2a and H_CB2c are interleaved into the interleaved block that follows the 
contiguous separation blocks, which means that: 

- the interleaved block IL1 remains unchanged; 

- H_CB2a is interleaved with CB2b and H_CB2b thereby generating an interleaved block CB2" 
20 which comprises the interleaved Video Objects H_CB2a/CB2b/H_CB2b. 

- H_CB2c is interleaved at the beginning of the block IL3 thereby generating a new interleaved 
block IL3' which comprises the interleaved Video Objects H_CB2c/IL3_l/IL3_2. 

In both cases the times sequence Is maintained. 

In figure 8 it is assumed that in the sliding window W2: 
25 - the first block Bk is an interleaved block (IL1) comprising two original Video object IL1_1 and 
IL1_2, and the associated two enhancement Video Objects H_IL1_1 and H_IL1_2, said Video 
Objects being interleaved in the following order: 
IL1_1/H_IL1_1/IL1_2/HJL1_2 ; 

- the second block Bf is a contiguous block (CB2); 
30 - the third block Bj+i is a contiguous block (CB3). 

According to the invention, the contiguous block CB2 is split into two contiguous blocks: a pre- 
separation block CB2a and a main block CB2b. 
CB2b is enhanced with H_CB2b. 

With a first implementation of the method of the invention (P10, the enhancement Video Object 
35 H_CB2a is interleaved into the interleaved block that precedes the contiguous pre-separation 
block, which means that: 

- H_CB2a Is interleaved in Bu thereby generating a new interleaved block IL1' which comprises 
the interleaved Video Objects IL1_1/H JU_l/ILl_2/H_IU_2/H_CB2a, 

- the interleaved block CB2' comprises the interleaved Video Objects CB2b/H_CB2b. 
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The pre-separatton block CB2a is inserted between the interleaved blocks IL1' and CB2'. And the 
post-separation block CB2c Is appended after CB2'. 

With a second implementation of the method of the invention (P20, the enhancement Video 
Object H_CB2a is interleaved into the interleaved block that follows the contiguous pre- 
5 separation block, which means that: 

- the interleaved block IL1 remains unchanged; 

- H_CB2a is interleaved with CB2b and H_CB2b thereby generating an interleaved block CB2" 
which comprises the Interleaved Video Objects H_CB2a/CB2b/K_CB2b. 

The contiguous blocks are split at the level of the Video Object Units. 

10 The first implementation of the invention is advantageous because it requires less 

memory and it simplifies the playback implementation. In this first implementation, the 
enhancement data are stored ahead of the separation blocks they are associated to. Therefore it 
is advantageous to use separation blocks of minimal size. According to the DVD specifications, 
the separation blocks have to contain a Pre-unit (PREU) because they precede an interleaved 

15 block. The minimal size of a Pre-unit corresponds to 1,5 seconds of video (see paragraph 2.4.67 
of the DVD specifications). 

A player 10 is represented in figure 9. The player of figure 9 is designed for reading a 
video signal 12 stored on a data carrier (a video disc 13 in this example). According to the DVD 
specifications, the video signal includes playback control data, called Navigation Data (N_data in 

20 figure 9) and data to be played back called Presentation Data (P_data in figure 9). The player 10 
comprises a Navigation Manager 30 and a Presentation Engine 35. The Presentation Engine 35 
follows instructions 32 Issued by the Navigation Manager 30 to play back the Presentation Data 
P_data from the disc 13. 

The Presentation Engine comprises an optical head 40 for reading the Presentation Data 

25 from the disc, and a processing unit 45 composed of software(s) and microprocessors) for 
processing the Presentation Data so as to output a signal to be displayed on a display 49. 

When retrieving a Video Object traditional players dont take into account the 
enhancement pointers PT_H that may be contained in it. 

Players according to the invention are specifically designed for reading the enhancement 

30 pointer PH _T contained in an original Video Object Unit so as to retrieve the associated 
enhancement Video Object Unit Then the original Video Object Unit and the associated 
enhancement Video Object Unit are processed together so as to deliver an enhanced signal to 
be displayed. These operations are implemented by way of a specific software executed by the 
processing unit 45. 

35 Figure 10 is a representation of an authoring system according to the invention. The 

authoring system of figure 10 comprises software memory means 50 storing a software SFT 
comprising instructions for implementing an enhancement method according to the invention, 
content storing means 52 for storing an original content P_S and enhancement data H_P_S, 
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processing means 54 for executing the software SFT so as to enhance the original content P_S 
with the enhancement data H_PJS and deliver an enhanced content P_S'. 

With respect to the described enhancement method, authoring system, data carrier, 
signal and reading device, modifications or improvements may be proposed without departing 
from the scope of the invention. The invention Is thus not limited to the examples provided. 

The word Comprising" does not exclude the presence of other elements or steps than 
those listed in the claims. 
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CLAIMS 

1. A method of enhancing a content comprising contiguous blocks containing a program 
stream and interleaved blocks containing interleaved program streams, said program streams 
being readable independently one from the other, occurrence of consecutive interleaved blocks 
in said content being forbidden, said method comprising a step of processing an original block of 

5 said content so as to interleave at least one enhancement program stream associated to at least 
one original program stream of said original block, said original program stream comprising 
original program units, and said enhancement program stream comprising enhancement 
program units, an original program unit being associated to a enhancement program unit, said 
processing step comprising: 
10 a) when said original block is a contiguous block: 

- checking whether interleaving said enhancement program stream(s) into said original block 
would lead to an occurrence of consecutive interleaved blocks in said content, and in such a 
case, 

- splitting said original contiguous block into a main block and at least one contiguous separation 
15 block, 

- using said contiguous separation block(s) to separate said consecutive interleaved block, 

- interleaving the enhancement program units associated to the original program units of said 
main block, if any, into said main block, 

- interleaving the enhancement program units associated to the original program units of a 

20 contiguous separation block, if any, into an interleaved block that is adjacent to said contiguous 
separation block, 

b) in other cases, interleaving said enhancement program stream into said original block; 

c) adding in said original program units a pointer pointing towards the enhancement program 
unit they are associated to. 

25 

2. A method of enhancing a content as claimed in daim 1, wherein the enhancement program 
unites) associated to the original program unit(s) of a contiguous separation block is Interleaved 
into the interleaved block that precedes said contiguous separation block. 

30 3. A method of enhancing a content as claimed in claim 1, wherein said separation block(s) 
comprise a number of original program units such that said contiguous separation block(s) have 
the smallest allowed size. 

4. A computer program comprising instructions for implementing a method of enhancing a 
35 content as claimed in one of claims 1 to 3 when said program is executed by a microprocessor. 
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5. An authoring system comprising storage means storing a program comprising Instructions 
for implementing a method as claimed fn one of claims 1 to 3 of enhancing an original content 
with at least an enhancement program stream, and processing means for executing said 
program so as to provide an enhanced content 

5 

6. A data carrier storing an enhanced signal obtained by applying a method of enhancing a 
content as claimed in one of claims 1 to 3. 

7. A signal obtained by applying a method of enhancing a content as claimed In one of claims 
10 lto3. 

8. A data carrier storing a signal comprising: 

- contiguous blocks containing a program stream and interleaved blocks containing interleaved 
program streams, 

15 - amongst said interleaved blocks, enhanced interleaved blocks comprising at least an original 
program stream comprising original program units and an associated enhancement program 
stream comprising enhancement program units, said original program units comprising a pointer 
pointing towards the enhancement program unit they are associated to, 

- and amongst said contiguous blocks, separation blocks separating a preceding interleaved 
20 block and a following interleaved block, said separation blocks comprising one or more original 

program unit(s) of an original program stream, one of said preceding and following interleaved 
blocks comprising one or more enhancement program unit(s) associated to said original 
program unit(s), said original program unit(s) comprising a pointer pointing towards the 
enhancement program unit they are associated to, 

25 

9. A signal comprising: 

- contiguous blocks containing a program stream and interleaved blocks containing interleaved 
program streams, 

- amongst said interleaved blocks, enhanced interleaved blocks comprising at least an original 
30 program stream comprising original program units and an associated enhancement program 

stream comprising enhancement program units, said original program units comprising a pointer 
pointing towards the enhancement program unit they are associated to, 

- and amongst said contiguous blocks, separation blocks separating a preceding interleaved 
block and a following interleaved block, said separation blocks comprising one or more original 

35 program unit(s) of an original program stream, one of said preceding and following interleaved 
blocks comprising one or more enhancement program unit(s) associated to said original 
program unit(s), said original program unit(s) comprising a pointer pointing towards the 
enhancement program unit they are associated to. 
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10. A device for reading a signal comprising original program units and enhancement program 
units associated to said original program units, said original program units comprising a pointer 
pointing towards the enhancement program unit they are associated to, said device being 
designed so as to retrieve the enhancement program unit associated to an original program unit 
via said pointer, and to process said original program units together wfth the associated 
enhancement program units in view of rendering an enhanced content. 
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ABSTRACT 

METHOD OF ENHANCING A PROGRAM STREAM 

The invention proposes a method of enhancing a content comprising contiguous blocks 
containing a program stream and interleaved blocks containing interleaved program streams, 
wherein the program streams are divided into program units and are readable independently 
one from the other, and the occurrence of consecutive interleaved blocks is forbidden. 

According to the invention: 

- each program unit of the enhancement program stream is associated to a program unit of the 
5 original program stream; 

- the enhancement program stream is Interleaved in the content at the program unit level in 
such a way that enhancement program units are as close as possible to the original program 
unit they are associated to, and occurrence of consecutive interleaved block Is avoided; 

- and the original program units are pointing towards the enhancement program units they are 
10 associated to. 

Application High definition Video on DVD 
Reference: Figure 7. 
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